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ABSTRACT 

\ 

y  For  a  system  of  differentiable  convex  inequalities,  a  new  bound 
is  given  for  the  absolute  error  in  an  infeasible  point  in  terms  of  the 
absolute  residual.  By  using  this  bound  a  condition  number  is  defined 
for  the  system  of  inequalities  which  gives  a  bound  for  the  relative 
error  in  an  infeasible  point  in  terms  of  the  relative  residual,  j.' 
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SIGNIFICANCE  AND  EXPLANATION 


Many  Important  problems  can  be  reduced  to  finding  a  feasible  point 
to  a  system  of  inequalities.  When  a  feasible  point  is  not  readily 
available  or  when  only  an  "approximate"  feasible  point  is  available,  one 
is  interested  in  determining  the  error  in  a  given  infeasible  point.  In 
this  work  we  show  how  such  error  can  be  bounded. 
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A  CONDITION  NUMBER  FOR  DIFFERENTIABLE  CONVEX  INEQUALITIES 


0.  L.  Mangasarlan 


1.  Introduction 

For  a  system  of  linear  equalities 

(1.1)  Ax  -  b 

where  A  Is  a  given  n*n  real  nonsingular  matrix  and  b  Is  a  given 
nonzero  vector  In  the  n-dlmenslonal  real  Euclidean  space  Rn,  the  norm 
of  the  Inverse  ||A-1 1|  and  the  condition  number  || A”1 1|  ||A||  provide 
the  following  useful  bounds  for  the  absolute  error  ||x-x||  in  terms  of 
the  residual  ||Ax-b||,  and  for  the  relative  error  in  terms  of  the 

relative  residual  C1  »6] 

(1.2)  IMII  <  HA-’ll  HAX.KII 

(1.3)  Jl-xlli  IA-1!!  UAH  JlA^blL 

Here,  x  Is  any  point  in  Rn,  x  is  the  exact  solution  A~b  and  ||*|| 
denotes  a  vector  norm  on  Rn  or  Its  subordinate  matrix  norm  [1,6].  The 
condition  number  |1  A” ^  ||  ||A||,  which  depends  on  the  specific  norm 
employed  and  which  Is  never  less  than  1,  provides  a  very  useful  stability 
measure  for  the  system  (1.1).  It  Is  the  purpose  of  this  work  to  obtain  a 
corresponding  number  for  the  system  of  Inequalities 
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where  g:  R  ■+■  R  Is  differentiable  and  convex  on  Rn.  The  key  to 
obtaining  a  condition  number  for  (1.4)  Is  the  definition  of  a  quantity 
that  plays  the  same  role  as  that  of  ||A_1||  for  (1.1)  and  which  would 
provide  an  error  bound  similar  to  (1.2).  In  [2]  Hoffman  extended  the 
bound  (1.2)  to  a  system  of  linear  Inequalities,  and  In  [5]  a  new  explicit 
expression  was  derived  for  that  bound  for  a  system  of  linear  Inequalities 
and  equalities.  In  [7]  Robinson  extended  the  bound  (1.2)  to  a  system  of 
convex  inequalities  that  define  a  bounded  feasible  region  with  a  nonempty 
interior.  In  Section  2  of  this  paper  we  shall  extend  the  bound  (1.2)  to 
a  system  of  differentiable  convex  Inequalities  which  satisfy  a  constraint 
qualification,  but  without  any  boundedness  assumption  on  the  feasible 
region.  The  diameter  of  the  bounded  feasible  region  which  appears  lin¬ 
early  In  Robinson's  bound  [7,  equation  (4)]  does  not  appear  in  our  bound 
(2.3).  In  Section  3  of  this  paper  we  employ  the  results  of  Section  2  to 
obtain  a  condition  number  for  (1.4)  and  thereby  extend  the  relative  error 
bound  (1.3)  to  a  system  of  differentiable  convex  Inequalities  satisfying 
a  constraint  qualification. 

We  briefly  describe  now  the  notation  and  some  of  the  basic  concepts 
used  In  this  work.  For  a  vector  x  In  the  n-dimensional  real  Euclidean 
space  Rn,  |x|  and  x+  will  denote  the  vectors  in  Rn  with  components 
lxlj  *  lxjl  and  (x+)j  “maxtx^.O),  1»l,2,...,n,  respectively.  For 
a  norm  ||x||g  on  Rn,  ||x||g*  will  denote  the  dual  norm  on  Rn,  that 
Is  IMIfl*  "  IWX  xy»  where  xy  denotes  the  scalar  product.  The 

l|y|l6-i 

generalized  Cauchy- Schwarz  Inequality  |xy|  <  ||x|L  ||y|L*,  for  x 
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and  y  In  R  ,  follows  Immediately  from  this  definition  of  the  dual 

11  o  _  ijr 

norm.  For  1  <  p,  q  <  «  and  -  +  -  ■  1  the  p-norm  (  l  |x^|p)p  and 

the  q-norm  are  dual  norms  on  Rn  [3].  If  IMIg  Is  a  norm  on  Rn, 

we  shall,  with  a  slight  abuse  of  notation,  let  IMIg  also  denote  the 

corresponding  norm  on  Rm  for  m  f  n.  For  an  mxn  real  matrix  A,  Ai 

denotes  the  1th  row  and  A.j  denotes  the  jth  column,  while  |[ A |( ^  denotes 

the  matrix  norm  [1,6]  subordinate  to  the  vector  norm  IMIg*  that  Is 

||a|L  *  max  ||Ax|L.  The  consistency  condition  ||Ax|L  <  ||A|L  ||x|L 
||x||s-1 

follows  Immediately  from  this  definition  of  a  matrix  norm.  We  shall  also 
use  ||*||  to  denote  an  arbitrary  vector  norm  and  Its  subordinate  matrix 
norm.  A  vector  norm  ||*||  on  Rn  Is  said  to  be  monotonic  If  and  only  If 
lxll  L  1^1*  1*1  »...»«*•  Implies  that  ||x||  <,  ||y||  [6].  The  p-norms 

1  <  p  <  •,  are  all  monotonlc  norms  [6],  A  vector  of  ones  In  any  real 
Euclidean  space  will  be  denoted  by  e.  For  a  differentiable  function 
g:  Rn  -*•  im,  Vg(x)  will  denote  the  mxn  Jacobian  matrix  evaluated  at  the 
point  x  In  Rn.  For  a  subset  I  e  {l,2,...,m},  gj(x)  or  91ej(x)  will 
denote  those  components  of  g^(x)  such  that  lei.  Similarly  Vg^x) 
will  denote  the  rows  (Vg{x))i  of  Vg(x)  such  that  lei. 


2.  An  Absolute  Error  Bound  for  Differentiable  Convex  Inequalities 
We  shall  use  the  approach  of  [5]  to  obtain  a  bound  (2.3)  for  the 
absolute  error  ]| x-p(x) )| ^,  where  x  Is  any  infeasible  point  for  (1.4) 
and  p(x)  Is  some  feasible  point  for  (1.4),  In  terms  of  the  absolute 
residual  ||g(x)+||g.  The  constant  y^  relating  these  two  quantities 
plays  a  similar  role  for  the  differentiable  convex  Inequalities  (1.4)  as 
|| A-1 1|  does  for  the  linear  system  (1.1). 

2.1  Theorem  Let  g  be  a  differentiable  convex  function  from  Rn  Into 
Rm,  let  S°  and  S  defined  by 

(2.1)  S°:«  {x|g(x)<0,  x«Rn}  c  S:»  {x|g(x)<0,  xeRn) 

be  nonempty  and  let  g  satisfy  the  following  asymptotic  constraint 
qualification 

/  For  each  sequence  of  points  {x^JcS  such  that  g j (x ^ )  *  0 

/  and  Vgj(x* ) f  0  for  I c {1 ,2,... ,m),  each  accumulation  point 

/  7g.  of  the  sequence  (VgJx1)}  when  the  latter  Is  bounded,  and 

(2  2)/  1  1 

\  of  the  subsequence  (Vg^x1  )/||Vgj(x* ) || }  when  (Vgj(x*)}  Is 

\  unbounded,  satisfies 
\  VgjZ  >  0  for  some  z  e  Rn 

Then  for  each  x  In  Rn  there  exists  a  point  p(x)  in  S  such  that 

(2.3)  l|x-p(x)||y  <  ygY  ||g(x)+||6 

where  y^  Is  a  constant  Independent  of  x  and  defined  by 
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(2.4)  a  sup  {||w||fiJpeS,  w>0,  wg(p)«0,  ||wVg(p)|L»l } 

PT  ”  w,p  p  1 

where  ||*||g*  Is  the  dual  norm  to  IMIg  and  is  the  positive 

constant  relating  the  y-norm  and  ®-norm  by 

llzllY  £  for  a11  Z€R" 

Proof  We  note  first  that  as  defined  by  (2.4)  is  finite  under  the 

asymptotic  constraint  qualification  (2.2).  For  if  not  then  there  exists 
a  sequence  {(w*,p*)}  such  that  w^  i  0  and  ||w^||  p*  «S,  w1  >  0, 
wig(p1)  ■  0  and  || w1Vg(p1 )  || *  *  1.  Since  w*g(p*)  »  0,  w*  >  0,  g(p’)  <  0, 
It  follows  that  gj(p*)  «  0  and  wj^j  *  0  for  some  fixed  nonempty  subset 
I  of  {!,... ,m)  and  for  a  subsequence  {(wi,p1)>ieL  of  {(w1,?1)}. 

Hence  >t«L  *  *»  II"i79j(p1  >l!f€L  *  1  and  Vgjtp1)  *  0.  For  the 

case  when  (Vg^p1)}^  is  bounded  the  subsequences  (Vgj(p*)}jcL  and 
{**l/l|w]  ||  )^eL  have  respective  accumulation  points  Vgj  and  Wj.  When 

(Vgjfp1)}^  Is  unbounded  the  subsequences  CVgj (p1  )/|| Vgj (p1 ) ||  and 

(w j/ 1| w^ ||  }^eL  have  respective  accumulation  points  Vg^  and  Wj.  In 

either  case,  since  ||wjvgj(p* )||1eL  *  1  and  {||wJ||}^eL  •,  It  follows 

that 

"l**l  *  °*  *1^°’  "  1 

This  however  contradicts  the  asymptotic  constraint  qualification  (2.2) 
that  7<jjZ  >  0  for  some  z  In  Rn.  Consequently  y^  is  finite. 

Now  for  any  x  In  Rn  not  In  S  define  p (x )  as  the  projection 

of  x  on  S  using  the  »-norm.  Hence  p(x)  and  some  fi(x)  >  0  solve 
the  following  convex  programming  problem 


(2.5)  min  {6  -e6<p-x<e6,  g(p)<0,  p«Rn,  6eR) 

P.6  1 

Note  that  since  S°  Is  nonempty  by  assumption,  the  Interior  of  the 
feasible  region  of  (2.5)  Is  also  nonempty  and  hence  p(x),  6 (x )  and  some 
u(x),  v(x)  and  w(x)  satisfy  the  following  Karush-Kuhn-Tucker  conditions 
[4]  for  (2.5)  where  the  explicit  dependence  of  p,  6,  u,  v  and  w  on  x 
has  been  dropped  for  simplicity 

1  -  e(u+v)  ■  0,  u  -  v  +  wVg(p)  ■  0,  (u,v,w)  >  0 
-e6  <  p  -  x  <  e6,  g(p)  <  0 

wg(p)  ■  0,  Uj(p-x-e6)j  ■  0,  Vj(-e6-p+x)j  «  0,  j»1,...,n 

From  the  last  two  equalities  It  follows  that  UjVj  »  0  for  j«l,...,n, 
because 

(p-x-ed)j  +  (-ed-p+x)j  »  -26  <  0 

Consequently 

(2.6)  p«S,  wg(p)  «  0,  w>  0,  HwVgJp)^  »  1 
Hence 

0  <  IIx-pL  ■  « 

■  6  +  u(p-x-e6)  +  v(-e6-p+x)  +  wg(p) 

■  x(v-u)  +  wg(p)  -  wVg(p)p 

■  wVg(p)x  +  wg(p)  -  wVg(p)p 

<  wg(x)  (By  convexity  of  g  and  w  >  0) 

<  wg(x)+ 


'<  IMIg*  Il9(x)+llg  (By  Canchy-Schwarz  Inequality) 
<  ^  ||g(x)+|L  (By  (2.4)  and  (2.6)) 

yce  p 

Hence 

11  x-Plly  <  l|x-PlL  £  Pfr  Il9(x)+IIB  D 

2.2  Remark  The  asymptotic  constraint  qualification  (2.2)  Is  merely  used 
as  a  sufficient  condition  for  the  finiteness  of  y^  as  defined  by  (2.4). 
Hence  Theorem  2.1  can  be  stated  with  the  constraint  qualification  (2.2) 
replaced  by  the  assumption  that  the  supremum  of  (2.4)  defining  y^  Is 
finite. 

He  give  now  a  simple  example  Illustrating  the  above  theorem  which  Is 
not  covered  by  Robinson's  result  [7,  equation  (4)]  because  the  feasible 
region  Is  unbounded. 

2  *1 

2.3  Example  S:-  {x|xeR  ,  x^>e  ,  x^O). 

It  Is  easy  to  verify  that  the  assumptions  of  Theorem  2.1  are  satisfied 
with  g^ (x):«  e  1  -  x2>  gg(x)  »  -x1  and  that 

sup{||w|lJp6S,  w>0,  wg(p)*0,  ||wVg(p) (N-l}  *  2 
w,p  1 

Consequently  for  each  x  In  R^  there  exists  a  p(x)  In  S  such  that 

ll*-P(x)IL<2  (eXl-x2)+ 

(-*1>+  - 

The  bound  y-a#  -2  is  sharp  here,  for  take  the  sequence  of  points 
x,  ■  -t,  x,  «  1  •  2t  with  t  a  nonnegative  number  converging  to  zero. 


II x-p(x)  11^  ^  ||-t,-2t|l,  2t 

l|g(x)+ll00  e-t-l+2t  e^-l+at 


which  approaches  2  as  t  approaches  0. 


A  Relative  Error  Bound  for  Differentiable  Convex  Inequalities 
We  extend  now  the  relative  error  bound  (1.3)  to  convex  differentiable 
inequalities  by  using  the  error  bound  (2.3).  We  will  again  use  the 
approach  of  [5]  and  will  need  the  following  simple  lemma  established 
there. 

3.1  Lemma  [5,  Lemma  2]  Let  IMIg  be  a  monotonic  norm  on  Rm  and  let 
a,  b  be  in  Rm.  Then  a  £b  Implies  that  ||(a)+||g  <,  ||b||g. 

The  following  Is  a  direct  consequence  of  the  above  lemma. 

3.2  Lemma  Let  g:  Rn  -+■  Rm  be  differentiable  and  convex  on  Rn  and  let 
||*  || g  be  a  monotonic  norm  on  Rm.  Then 

Ilg<o)+llB  <.  ll^g(o)p|lB  f°r  g(p)  <  o 

Proof  By  the  convexity  of  g,  0  >  g(p)  >  g (0)  +  Vg(0)p.  Hence  applying 
Lemma  3.1  to  g(0)  <  -Vg(0)p  we  obtain  the  desired  inequality.  □ 

3.3  Theorem  (Condition  number  bound)  Let  the  assumptions  of  Theorem  2.1 
hold,  let  g(0)+  f  0  and  let  ||*||g  be  a  monotonic  norm  on  Rm.  Then 
for  each  x  in  Rn  there  exists  a  p(x)  in  S  such  that 


(3.1) 


l|x-p(x)|l6 
l|p(*)ll8  ~*u 


l|g(x)Jg 

llg(o)+lle 


where  ygg  is  defined  by  (2.4),  and  Vgg  II Vg (0) ||g  defines  the  condition 
number  of  (1.4). 

Proof  For  each  x  in  Rn  there  exists  a  p(x)  in  S  such  that 


(By  Theorem  2.1) 


ll*-p(x)llg  ^  Il9(0)+llg  ll9(x)^llB 
IIp(x)II6  IIp(x)I!6  ||9(0)+j|g 


Hvg(Q)p(x)Hg  llg(x)J|B 
LV*e  llpOOIIg  ll9«»J6 


(By  Lemma  3.2) 


l|V9(0)|ls 


ll9(»)Je 

tl9(0)J|g 


0 


For  Example  2.3,  It  Is  easy  to  verify  that  || Vg(0) || ^  »  2  and 
hence  the  condition  number  for  the  example,  using  the  «-norm,  Is: 

H»oJvg(o)IL  • 4- 
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